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(54) Abstract Title 

Ring network formed from stackable units with self configuration system based on port connection status 



(57) A stackable network hub unit comprises *up' 12 and 'down' 11 ports with data paths 14,15 between 
them. Means are provided at each port to detect the presence of a link to another stackable unit and the type of 
link, if no unit is detected the port is bypassed and data packets are directed from one data path to the other, as 
per UNITS 1 and 3, and the ring network is thereby formed. A 'resilient' cable may be connected between the 
'up* port of the top unit and the 'down' port of the bottom unit on the stack (Fig. 4) to allow a bidirectional ring 
to be formed, that can operate with one link of unit out of service. 

The network units contain configuring means which transmit configuration packets containing source 
unit identification and its 'down* port connection status data, ie. normal connection, resilient cable or no 
connection. A unit receiving the packet compares this 'down' port status data with its own 'down' port status 
according to the table. If it wins it transmits a new configuration packet with its own identifier and port status, 
if not it forwards the packet It received. When a unit receives a packet with its own identification it becomes the 
bottom of the stack and other units are numbered therefrom. This scheme allows hot configuration of the 
stack and can accommodate hub unit failure and incorrect use of connection cables. 
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METHOD .ANTD APPARATUS FOR CONFIGURATION OF STACK.ABLE UNITS IN 
PACKET-BASED COMiVfU^TC ATION SYSTEMS 

Field of ihe Invention 

The present inveniion relates lo stackable units in packet-based communication systems 
and in panicular to "stackable' hub units which can be 'stacked' or connected so that the 
units form a single logical entity. 

Background to the Invention 

When units are stacked to form a single logical device such as a hub or switch, a user 
connected to a port of any one of the units can send packets lo or receive packets from 
users connected to any of the pons on any of the units, as if all the ports were ports of a 
single device. In such a system, the units have to be connected to form a closed path or 
ring by means of which packets can circulate from the unit having the pon at which they 
are received to the unit having the port to which they need to be forwarded. 

It is necessary to provide some means of arbitration between requests by the units for 
access to the ring, that is to say for the ability to place a packet on the ring. This may be 
achieved in practice, as disclosed in GB patent application number 9812081.9 filed 5 June 
1998, and in the corresponding United States patent application serial number 09/207655, 
in the name Brewer et al, filed 9 December 1998, by providing in each of the units a state 
machine which enables each unit to request access to the ring by forming an arbitration 
packet resembling an Ethernet packet but containing a header which defines levels of 
priority, and other status information. Broadly, each of the units is responsive to packet 
headers circulating with arbitration and priority fields to conduct an arbitration process 
which enables one and only one of the units to be a master v^'hich supplies packets to the 
ring until it has no more packets to supply, whereupon another unit requesting access to 
the ring can become the master. 
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In order to enable units to operate in this manner, the aforementioned patent applications 
describe a physical structure in which each unit has a two duplex ports, known as the 
^'down" and 'up'- ports respectively^ Each of the units defines two signal paths, one 
proceeding from the -down" port to the "up" pon and the other in the reverse direction. 
The tlrst of these paths may contain the arbitration process by which in normal operation 
of the stack the idemity of the master unit is established and, for that unit, packets are 
allowed to enter the ring The second path is a return path by means of which packets 
return around the ring Each unit is so organised that if there is no connection to a 
particular pon, packets or frames on the path to that port will bypass the port and be 
transmitted back along the other path towards the other port of the same unit. If a port is 
connected to a port on another hub unit, then a packet arriving at that port will be 
fonvarded to the other hub unit. The units are, or should be, connected so that one, and 
only one of them is at the ^bottom' of the stack. Such a unit should have no unit 
connected to its 'down' port. It wUl preferably be the only unit in an idle master state as a 
preliminary to the arbitration process which can occur only if at least one unit needs 
access to the ring for placing packets thereon. 

In a practical system up to eight units can be connected together using connection cable 
and appropriate connectors. A facility which is desirable in such a system is the use of a 
"resilient" or loop-back cable which enables the ring to be completed even if there is a 
failure of a single unit withm the stack. It is also desirable to enable the "hot" insertion or 
removal of units, that is to say the insertion or removal of a unit in an operational stack 
without requiring cessation of the operation of the stack or its powering down. 

Since a multiplicity of units can physically be connected in a large selection of different 
ways, including ways which may be impermissible, it is highly desirable that the units 
incorporate a configuration process which will automatically select a single unit to be 
designated as the bottom of the stack. 

The main object of the present invention is to provide such a configuration process. Other 
objects of the invention are to accommodate loop back and improper imerconnection. 




The invention is based on the use of configuration packets which are sent around the 
cascade ring. In a preferred form of the invention, these packets contain inforniation 
indicating that they are not vahd data or packet conveying information from one user to 
another, as well as other status and address information which enables a unit which 
receives a configuration packet to perform a comparison between status information in ilie 
configuration packet and status information of the unit. If a unit ^ loses' the comparison 
process, it will forward any subsequent configuration packets. If the unit 'wins' the 
comparison it may source its own configuration packets. The information contained in the 
packets and the processing of the packets is selected so that the configuration process 
ends with a single one of the units deemed to be the bottom of the stack. The process is 
preferably conducted such that the stack performs a numbering programme which enables 
the detection of "illegaf^ stacks, that is to say stacks which are improperly connected 
using, for example, more than one loop back cable (hereinafter called resilient cable'). 

The features which form the basis'of the invention and constitute preferred options within 
it will be flinher explained in the following, with reference to the accompanying drawings 

Brief Description of the Drawings 

Figure 1 illustrates a cascade or ring of hub units. 

Figure 2 illustrates diagrammatically a stack of connected hub units. 

Figure 3 illustrates pan of a hub unit in greater detail. 

Figure 4 illustrates a stack of units and a resilient cable. 

Figure 5 illustrates a header for one type of a configuration packet 
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Figure 6 illustrates a header for another type of configuration packet. 




Figure 7 illusiraies a process of comparison between status fields of a configuration packet 
and the status of a unit 

Figure 8 illustrates a terminal connector. 

s •■ 

Detailed Description of the Preferred Embodiment 

Figure 1 illustrates schematically three stacked hub units, designated 'unit 1', 'unit 2\ and 
'unit 3\ connected together to form a ring for the circulation of packets that may be put 

10 on the ring by any one of the units. It will be understood that only one unit at any time 

may in normal operation place packets on the ring. Each of the units is similar and for 
convenience only the middle- unit will be described in detail. This unit is a hub unit 10 
which has two duplex ports, a first port 1 ], conveniently called 'down' p.ort and a second 
pon 12. conveniently called 'up' port. The unit 10 has two signal paths. A first path, 

15 which for various reasons is preferably termed the arbitration path, proceeds from the 

'down' port 1 1 of the unit to the 'up' pon 12. It is convenient to sub-divide the functions 
of the ports into receive and transmit (Rx and Tx respectively). Thus the arbitration path 
13 proceeds from the down Rx terminal to the up Tx terminal. A second or return path 14 
extends from the pon 12 to the pon 11, and in particular from the 'up Rx' pan of the 

20 second pon 12 to the 'down Tx' pan of pon 1 1 . 

The forward or arbitration path 13 includes a processing section 15 which in the normal 
operation of the hub unit cooperates with arbitration packets that are sent around the ring 
and which, as briefly described later, and more fijlly described in the aforementioned 

25 applications, enable the units to determine which will be the master unit (placing packets 

on the ring) at any time in a manner which grants the units a fair access to the ring. In 
Figure 1, the processing function 15 is shown as connected to a transmit (TX) section 17 
and a receive (RX) section 18. These are intended to represent the transmitting and 
receiving functions respectively of the hub unit, which in respect of its connection to pons 

^o (not shown) is intended to be of known form A single hub can broadcast a packet 

received at any pon to all its other pons and the purpose of stacking units is to provide a 



hub unit with many more pons than can convenieniiy be provided on a sinule 
commercially acceptable unit 

Figure 2 illustrates a simple way of connecting a cascade of units so that they form a 
mutual ring as indicated in Figure I. In the simple connection shown in Figure 2, the ^up' 
pore of the lower of each adjacent pair of units is connected by a known form of cable to 
the "down^ port of the next unit up Figure 2 illustrates four stacked units arranged in this 
manner. 

Before leaving Figure 2, and by way of introduction to Figure 3. it may be remarked that 
each unit is adapted to sense whether a given poa is connected to another operative unit. 
This may be performed in known manner, by the process set out in IEEE standard 802.3 - 
1998, clause 37, but briefly, the effect is that if a pon is not connected to another operative 
unit, the unit causes that port to be internally bypassed by packets which would otherwise 
proceed towards that port. Thus as shown for unit I, for which the 'down' port is not 
connected to another unit, packets that would proceed along the return or repeat path 
towards the down port internally bypassed that pon and proceed to the first or arbitration 
path. Likewise, as shown for unit 3, of which the 'up* pon is not connected to another 
unit, packets that proceed towards the 'up' pon along the arbitration path internally 
bypassed that port to the return path. In this manner, as also explained in the 
aforementioned patent applications, the units define a cascade within which is provided a 
ring for the circulation of packets, enabling both arbitration for access to the ring, and also 
enabling packets to pass from one unit to the others. 

In the example shown in Figure I, unit 1 is at the 'bottom* of the stack. As will be further 
explained hereinafter, owing to the possibility of the use of 'resilient' cable or incorrect 
combinations of cables, h cannot be presumed that unit 1 will be at the bonom of the stack 
and it is desirable to provide a configuration process by means of which the unit that 
effectively is at the bottom of the stack is determined. 

Figure 3 illustrates the general layout of a unit. This is generally in the form described in 
the earlier applications and accordingly need only be described in a summary form 



Signals received at the down RX terminal !0! are de-serialised in block 102. aligned iti 
block 103. decoded in an 8B10B decoder 104, stored temporarily in elastic buffer 105, and 
coupled to one input of multiplexer 106 The output of multiplexer 106 is coupled to an 
arbitration unit 107 (generally described in the aforementioned applications) and the 
arbitrator path includes a multiplexer 108, an SB lOB encoder 109, and serialiser 110 
coupled to the up transmit terminal 111. 

The down path commences with the up receive terminal 112 and proceeds through a 
deserialiser 113, an alignment block 1 14, an 8B10B decoder 115, an elastic buffer 1 16, a 
multiplexer 117, an 8B10B encoder 118, and a serialiser 119 to the down transmit 
terminal 120 

A conventional auto-negotiation circuit 123 is coupled to the decoder 104 and the encoder 
1 18 and a corresponding auto-negotiation circuit 124 is connected to the decoder 1 15 and 
the encoder 109. 

Among other things, the purpose of the multiplexers 106 and 117 is to provide a bypass of 
the down pon (101/120) and one purpose of the multiplexer 108 and the multiplexer 117 
is to provide bypass of the up port (111/112). Multiplexer 108 also serves, under the 
comrol of the arbitration unit 107, to provide packets onto the ring if the unit is acting as a 
master, as described in the aforementioned applications. Packets from ports (not shown) 
arrive by way of a bus 125 Packets can leave the ring at arbitration unit 107, if the 
respective unit is the -master', and travel by way of bus 126 to those ports. At all other 
units in the ring, the arbitration unit copies the packet to the encoder 109 via the 
multiplexer 108 and, if the relevant destination box id is set, also copies the packet to the 
bus 126. 

A link detection function 128 coupled to decoder 104 is generally configured as a RX sync 
function in accordance with the IEEE standard 802.3 -1998 Clause 37, but may include an 
error rate threshold counter with a threshold which, if exceeded, is used as a criteria for a 
link fail Thus if the down port ( 101/120) is not receiving signals, either the unit is at the 
bottom of the stack or a stack failure has occurred. There is also a link detect ftinction 127 



which is coupled to decoder 1 15 The link detect functions 127 and 12S can deierniine by 
way of the cascade configuration function 129, operate multiplexers 106, lOS and 117. 
depending on circumstances, so that if there is no unit connected to the down pon. packets 
or headers arriving at multiplexer 117 will be routed by way of multiplexer 106 back to 
the up path. Likewise, if there is no unit connected to the up pon. packets or headers 
passing through arbitration unit 107 and arriving at multiplexer lOS will be routed by way 
of multiplexer 1 17, thereby bypassing the up poa. 

Thus when a cascade pon is connected to another port it will rlrst use (in this example) the 
RX sync function to establish if a valid connection exists. If so, it will auio-negotiaie to. 
establish the capabilities of the connected device and, if the device is capable of bemg 
connected in the cascade, this will be indicated to the Imk detecr block and the 
multiplexers will be set such that the pon is connected into the cascade ring. 

Figure 8 illustrates a standard form of connector, an eight pin shielded ANSI fibre channel 
style-2 connector which may have a mechanical mating interface as defined by lEC 
61076-3-103. In essence pins 1 and 3 of this connector constitute the transmit path and 
pins 6 and 8 constitute the receive path, pins 1 and 8 being positive and pins 3 and 6 being 
negative. Connection of pins 4 and 5 denotes a 'resilient' cable. The connection may be 
sensed internally by means of a pull-up resistor connected to pin 4 and a ground 
connection to pin 5, so that pin 4 will go 'low' for a resilient cable. 

In the simply connected system shown in Figure 2, it is easy to identify which unit is at the 
'bottom' of the stack. However, it is not necessary to make such a simple connection 
wherein each unit has its *up' port connected to the ^down' pon of the unit which is 
physically next to it in the ascending direction. Furthermore, it is customary and desirable 
to employ a loop back cable such as is shown in Figure 4 wherein unit 4 in that Figure has 
its "up" port connected to the 'down' port of unit 1. The advantage of using a resilient 
cable is that it enables a maximum of units to continue functioning in the event that one of 
the units is subject to failure. 




The configuration phase has several sub phases. First, it needs to detect vahd code words 
and auto-negotiation to determine that a connection with vahd coding exists on its 
cascade up or cascade down pons and that the connected unit is either operating as a 
cascade unit or is capable of so doing Second, having verified that a vahd connection 
exists, the unit must connect to that unit by setting the data path multiplexers appropriately 
so that the up or down port for both of them as the case may be) is no longer bypassed. 
Third, It needs to send configuration frames (which may be generated in the arbitration 
unit 107) in order to resolve the bottom of the stack condition and unit numbering. 

Once the ^bottom of stack' has been resolved, a unit needs to enter the idle master 
arbitration state if the unit is at the bottom of the stack or the idle state if it is not. 

Configuration may need to be perform.ed when power is turned on or reset. Funher, link 
status changes can occur when units power up or down or cables are removed. The 
insertion or removal of a cable may cause several status changes because in practice a 
resilient cable detection circuit is separate from the data circuit. Funher, a system may 
enter the configuration state if a unit fails to detect an arbitration header within a set length 
of time, typically set to be twice the maximum length of the packets plus some arbitrary 
margin. Furthermore, whenever a packet passes the 'bottom of stack' unit, that unit sets a 
bit (illustrated as the ^boss' bit) to indicate its presence. This provides two detectable error 
conditions. First, if the master is stripping its own packet off, the bit is not set then a ring 
master error has occurred. Second, if the bottom of stack unit receives a packet with the 
boss bit set and no parity error, there is a boss error either because there are no masters on 
the ring or there is a second unit that is acting as if it were the bottom of the stack. 

The general principle is that if any of the above circumstances are detected, then a unit 
may send out a configuration packet. These packets are sent out without arbitrating for 
access to the ring. Such a packet is shown in Figure 5. Figure 5 illustrates a configuration 
packet as put on the ring It has an Arb/'Gnr field set to '0^ to indicate that it is not an 
arbitration packet and a ^config' field se: to to indicate that it is a configuration packet. 
The 'boss' field is '0^ because the bottom of the stack has not yet been restored. The 



packet will have its Moop\ none' and normar bits set as indicated below and its BoxiD 
field set as explained below. 

Figure 6 illustrates a configuration packet which is provided by a unit in a repeat mode 
The symbol R means that the values possessed by a packet as received are merely 
repeated. The only change is the incrementing of the BoxID field by unity. 

A packet such as shown in Figure 5 indicate the down pon status of its source unit and 
will be compared with the down pon status of a unit that receives it, according to the table 
shown in Figure 7. 

In the configuration packets and Figure 7, 'Nothing present' means that there is no other 
unit connected to the relevant down pon that is to say nothing being received is indicated 
by the link configuration for that pon. This would normally indicate that the unit is at the 
bottom of the stack but it could occur (as indicated above) if a unit in the middle of the 
stack failed, leaving the unit above it seeing 'nothing present'. 

'Resilient cable' means that the down pon has a resilient cable present, as indicated by a 
status signal specific to this type of cable on one of its connector pins. This parameter is 
assened regardless of whether anything is being received on the down port. 

'Normal cable' means that there is a unit connected to the down pon of the unit, and valid 
activity is being received from it, as indicated by the link configuration. 

These three parameters in the source unit are indicated by the 'none', Moop' and 'normal' 
fields and are used to determine if a unit is at the bottom of the stack by the following 
reasoning: 

(a) If there is no resilient cable being used wqihin a stack and all the units are working 
correctly, only the 'bottom' unit will see 'nothing present'. All the other units will see 
'normal' cable at their down pons. Clearly therefore the bottom unit is at the bottom of the 
stack. If a resilient cable is beine used in the stack it must be connected between the. 
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bottom of the stack unit and the top of the stack unit (units 1 and 4 in Figure 4). Since 
there is now no unit present in the stack with nothing present, the oniy way of 
distinguishing the bottom of the stack unit is by way of the presence of the resihent cable 
on the down port. If while a resiUent cable is being used one of the units in the stack 
fails, then the unit above it will see nothing present. In this case the unit with the resilient 
cable connected to its down port is still the ^bottom of stack'. 

However, there are other circumstances which can be accommodated by the resolution 
scheme shown in the table. If a customer chooses to use several resilient cables within a 
stack or if he chooses to try and use a normal cable as a resilient cable, it is desirable to 
ensure that the stack still works even though the stack numbering may not be 
conventional and to resolve a single unit to perform the bottom of stack functions. 

The table summarises the decision each receiving unit must make based on the cable 
status of its own cascade down pon versus that indicated by the configuration packet. If 
the result is ^win' the unit enters the configuration master mode and must continue as a 
source for configuration packets until it sees its own packet returned, as indicated by 
unique MAC address for each unit. 

If the result is 'lose', the unit must enter a configuration repeat mode wherein it repeats the 
incoming configuration packets, but modifies them so as to increment the unit number in 
the status box location as shown by the packet in Figure 6. The configuration master mode 
will provide such a packet with this value set to zero. The resulting number is stored and 
will become the stack unit of that number, that is to say the physical location of the stack, 
once the 'bottom of stack' is resolved. 

If the result is Mowest address wins', there is a mis-configuration in the stack and the 
unique MAC address value is used to resolve the decision. 

The option shown in Figure 7 is either Xose' or ^Lowest MAC address wins'. The former 
will prevent a loop being made with normal cables because the configuration process 



tl 



would continue indefinitely but the latter will allow a loop to be made with normal cables 
instead of a resilient cable 

The result of this process if that one and only one unit will remain as the configuration 
master, sourcing configuration packets onto the ring while all the other units merely repeat 
the packet and store the result of the incremented status box value as there are source unit 
numbers. The single remaining configuration master will thus be ^bottom of the stack' 
and all the other units will be numbered in ascending order above it. 

In the case of a mis-congfiguration the units will still be numbered in ascending order 
from the configuration master which will assume the 'bottom of stack' function, but its 
location may be anywhere within the stack. 



Claims 



I A stackable network unit including a first pon and a second pon. a first path for data 
packets from said first pon to said second pon, a second path for data packets from said 
second port to said first port, means for detecting the absence of another operative unit 
connected to said first pon to cause data packets on said second path to bypass said first 
pon and proceed on sa:d first path and for detecting the absence of another operative unit 
connected to said second pon to cause data packets on said first path to bypass said second 
pon and proceed on said second path, whereby the unit can form a ring communication 
system with other units, the stackable unit including configuring means which can 
cooperate by means of coded configuration packets with said other hub units to establish a 
numerical ordering of the units in the ring, each such packet including fields which 
indicate the nature of the packet, the status of the first pon of the unit which was the 
source of the packet, a unit number and a device address; the unit being operative on 
receipt of such a packet from another umt by way of its said first pon to compare the 
status information in the packet with the status of its own first pon and depending on that 
comparison to generate a packet which has that unit's status and address mformation and a 
datum number or to forw^ard the frame as received with incrementing of its unit number, 
the unit being further operative to determine whether it has received its own configuration 
packet by a comparison of the address data in the packet with its own address 

2. A unit according to claim 1 wherein said first path includes means for coupling data 
buses to said path for enabling data packets to be put on said ring and to be taken from 
said ring. 

3. A unit according to claim 2 wherein a configuration packet denotes said status by fields 
which respectively indicate no connection, a normal connection and a loop-back 
connection. 
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ffTendments to the claims have 



n filed as follows 



Claims 



1. A stackable network unit including a first pon and a second pon, a first path for data 
packets from said first pon to said second pon. a second path for data packets from said 
second pon to said first pon, means for detecting the absence of another operative unit 
connected to said first pon to cause data packets on said second path to bypass said first 
pon and proceed on said first path and for detecting the absence of another operative unit 
connected to said second pon to cause data packets on said first path to bypass said second 
pon and proceed on said second path, whereby the unit can form a ring communication 
system with other units, the stackable unit including configuring means which can 
cooperate by means of coded configuraiion packets with said other units to establish a 
numerical ordering of the units in the ring, each such packet including fields which 
indicate the nature of the packet, the connection status of the first pon of the unit which 
was the source of the packet, a unit number and a device address, the unit being operative 
on receipt of such a packet from another unit by way of its said first pon to compare the 
connection status information in the packet with the connection status of its ow^n first pon 
and depending on that comparison to generate a packet which has that unit's connection 
status and address information and a datum number or to forward the frame as received 
with incrementing of its unit number, the unit being funher operative to determine 
whether it has received its own configuration packet by a comparison of the address data 
in the packet with its own address. 

2. A unit according to claim 1 wherein said first path includes means for coupHng data 
buses to said path for enabling data packets to be put on said ring and to be taken from 
said ring 

3. A unit according to claim 2 wherein a configuration packer denotes said connection 
status by fields which respectively indicate no connection, a normal connection and a 
loop-back connection. 
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